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ABSTRACT 


The  capacity  expansion  problem  for  flow  networks,  first  studied 
by  D.  R.  Fulkerson,  is  reexamined.   In  the  case  where  no  free  initial 
capacity  is  available,  it  is  shown  that  the  optimal  expansion  takes 
place  on  the  arcs  of  the  cheapest  chain  in  the  sense  of  unit  expansion 
costs  through  the  network.   The  proof  makes  use  of  Dantzig's  decomposi- 
tion principle  of  linear  programming.   In  the  case  where  some  free 
initial  capacity  is  available,  an  algorithm  based  on  the  topological 
dual  is  presented.   This  algorithm  does  not  require  that  the  flow  network 
be  planar  and  can  be  easily  extended  to  problems  having  positive  lower 
bound  restrictions  on  arc  flows,  problems  having  bounds  on  individual 
arc  expansion  or  nonlinear  convex  expansion  costs,  and  capacity  reduction 
problems . 

This  research  was  sponsored  by  the  Foundation  Research  Program  of 
the  Naval  Postgraduate  School. 
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1.   INTRODUCTION 

Suppose  we  have  a  connected  network  G(N,A)   consisting  of  a 
set  of  nodes  N  and  a  set  of  arcs  A.   Let  the  integers  i  =  1,2,...,P 
represent  the  nodes  and  the  two-tuples   (i,j)  (i  =  1,2,...,P; 
j  =  1,2,...,P;   and   i  ^  j)   represent  the  arcs.   Let  node  1   corre- 
spond to  the  source  and  node  n  correspond  to  the  sink.   The  arcs 
are  assumed  directed  so  that  the  order   (i,j)   implies  an  arc  directed 
from  node   i   to  node  j . 

Let  M. .  ^  0   represent  the  initial  flow  capacity  of  arc   (i,j), 
Y..  ^  0   represent  the  added  flow  capacity,  and  X..  ^  0  represent 

the  actual  flow  in  the  arc.   Let  Q  represent  the  net  flow  through 

P 

the  network  from  node  1   to  node  £.   Let   B  ^  0  be  the  total 

resource  budget  available  and  let  a..  ^  0  be  the  cost  per  additional 

iJ 

unit  of  capacity  added  to   (i,j). 

The  capacity  expansion  problem  for  a  flow  network  was  first 

studied  by  Fulkerson  (1959) .   He  referred  to  it  as  the  parametric 

budget  problem  and  stated  it  as  follows:   Find  nonnegative  values 

of  X..   and  Y..   which 
ij        il 

maximize  Q,  (la) 

subject  to   £  (X  -X  )  =  Q, 
j    J   J 

I    (X..-X..)  =0     (i  =  2,3,...,P-1),       (lb) 
j    1J   J1 

I    (Xpj-X  >  =  -  Q, 

3 

X.  .  -  Y.  .  £  M..      ((i,j)  €  A),  (lc) 

ij    iJ     iJ 


I   L  a..Y..  <;  B.  (Id) 


In  contrast  to  Fulkerson  we  write  the  budget  constraint  (Id)  in 
inequality  form  although  it  is  obvious  that  equality  will  hold  at 
optimality  if  Y . .   is  not  required  to  be  integer  valued. 

An  easy  way  to  solve  (1)  is  to  construct  a  network  having 
two  parallel  arcs  in  place  of  each  original;  one  with  a  cost  of 
zero  and  one  with  a  cost  of   a...   The  capacity  of  the  arc  having 
zero  cost  would  be  M. .   while  the  other  would  be  infinite.   A  minor 
modification  of  the  Primal-Dual  algorithm  of  Ford  and  Fulkerson  (1957) 
can  then  be  used  to  find  the  maximal  flow  which  can  be  allocated  for 
the  available  budget.   The  resulting  algorithm  is,  in  fact,  the  one 
given  by  Fulkerson  (1959)  in  his  presentation  of  the  parametric  budget 
problem. 

In  this  paper  we  would  like  to  first  consider  the  special  form 
of  (1)  when  M. .  =0.   We  will  state  the  associated  optimal  solution 
and  prove  it  constructively  using  the  decomposition  principle  for 
linear  programs  (Dantzig  (1963)).   We  will  then  present  an  algorithm 
for  solving  the  general  form  of  (1)  which  makes  use  of  the  topological 
dual  of  the  network. 


2.   OPTIMAL  SOLUTIONS  WHEN  M..  =  0 

The  form  of  (lc)  reduces  to 

X. .  £  Y. . 

when  M. .  =  0  and,  in  fact,  is  equality  for  all  arcs  since  the 

budget  will  be  used  up  in  obtaining  the  maximal  possible  flow.   We 

can  therefore,  drop  (lc)  from  further  consideration  if  we  rewrite 

(Id)  as 

7  7.  a..X..  =  B.  (2) 

L   Lk     ij  ij 

The  optimal  solution  to   (la,b)  and  (2)  is  given  by  the 
following  theorem. 


m 


Theorem:     Tke  maximal  llow  will  be  bent  oveA  that  chain    C 

u  i 

directed  ^iwm  6oun.ce  to  6  Ink  which  ii>  the  bkoKteAt  to  tutu  when 
tke.  ojic  length  o^     (i,j)     it>  i>et  equal  to     a...     Tke  value  ofi 
the.  maximal  falow  and  the  ilow  capacity  in  each  axe  o&  that 
chain  ti>  given  by 

u 

max  Q   =  =  Y .  .  . 

y  y    a.       1J 

L   LC        ij 
m        J 

Tke  ilovo  capacities  in  all  otkeA  an.a  one  zeAo . 

Proof:  Let  us  begin  by  adding  an  arc  (P,l)  to  the  network 
and  then  write  (lb)  as  EX  =  0  where  E  is  the  node-arc  incidence 
matrix  of  our  augmented  network,  X  is  the  augmented  column  vector 
of  arc  flows  (with  X    in  the  last  position) ,  and  0   is  null 


column  vector.  We  write  (2)  as  aX  ^  B  where  a  =  (a..)  is  a  row 
vector  with  a  .  =0  in  the  last  position.  Our  problem  is  then  to 
find   X  ^  0  which 


maximize  X   ,  (3a) 

subject  to   EX  =  0,  (3b) 

and  aX  <£  B.  (3c) 

In  decomposed  form  we  will  combine  (3a)  and  (3c)  into  the 

master  program.   The  flow  conservation  equations  (3b)  and  X  ^  0 

will  be  the  constraint  set  of  the  subprogram.   The  master  program 

is  therefore  to  find  A.  ^  0,   x  ^  0  which 

1         s 

(i) 
maximize 


I      bX^;A.,  (4a) 

i 


subject  to   £  aX(l)A.  +  x  =  B.  (4b) 

i 

If  the  network  has  m  arcs  then  b   is  an  1  x  m  +  1  vector  con- 
sisting of  zeros  in  the  first  m  positions  and  a  one  in  the  last 
position.   The  subprogram  is  to  find  X  ^  0  which 

maximizes   [b  -  TTa]X,  (5a) 

subject  to   EX  =  0. 

We  are  using   tt   to  represent  the  simplex  multiplier  associated  with 

(4b) .   Each  X     used  in  the  master  program  is  a  homogeneous  solu- 

to  the  subprogram  and  therefore  we  have  no   £  A .  =  1   constraint  in 

i 
the  master. 


The  iterative  solution  procedure  begins  by  finding  the  basic 

feasible  solution  x  =  B   to  the  first  restricted  master  which  has 

s 

only  one  variable;  namely,   x  .   The  multiplier   tt   is  then  determined 
and  used  to  provide  the  first  objective  function  for  the  subprogram. 
If  a  solution  to  the  subprogram  can  be  found  such  that 


[b  -  TTajX  >  0  (6) 

then  we  use  that  solution,  call  it  X    ,   to  generate  a  new  coeffi- 
cient vector  for  the  restricted  master.   The  second  restricted  master 

program  would  then  be:   Find  Xn    ^  0,   x  ^  0  which 

1        s 

maximize  bX   A  , 

subject  to   aX  ^X,  +  x  =  B. 
J  Is 

A  new  value  of   it   would  be  determined  and  used  to  generate  a  new 

objective  function  for  the  subprogram.   A  new  solution  to  the  subproblem, 

(2) 

X    ,   would  be  determined  and  tested  using  (6) .   If  it  fails  the 

test  then  the  solution  process  terminates.   If  it  passes  the  test 

then  it  is  used  to  create  a  new  restricted  master  program  involving 

variables   A, ,   A„,   and  x  . 
12         s 

The  process  terminates  after  the  k  iteration  where  X 
is  the  first  solution  from  the  subprogram  to  fail  the  test.  The 
optimal  solution  X*   can  be  obtained  from  (7) . 

k      ... 
X*  =   T   X.XU;"  (7) 

i=l   X 


The  basic  feasible  solution  to  the  first  restricted  master 

was  observed  to  be  x  =  B.   Because  there  is  a  zero  coefficient 

s 

for   x    in  (4a)  we  get   tt  =  0   as  the  value  of  the  simplex  multi- 
plier for  the  restricted  master  and  the  objective  function  for  the 
subproblem  is  therefore  bX  =  XT>1  .   A  homogeneous  solution  to  the 
first  subprogram  is  easily  provided  by  selecting  any  cycle  directed 
from  the  source  to  the  sink  and  back  to  the  source  which  includes 
arc   (P,l)   and  allows  as  much  flow  as  possible  to  pass  over  it. 
Since  there  are  no  flow  capacity  restrictions  in  the  subproblem  we 
could  have  Xp1  -*■   °°.   If  the  solution  to  (3a,  b,  c)  is  unbounded 

this  condition  will  be  provided  by  A  .  ■+   °°  for  some  solution  in 

i 

(4a,  b)  so  we  need  only  send   1   unit  over  the  cycle  in  the  sub- 
problem  to  indicate  the  homogeneous  solution  route.   Thus,  we  return 
to  the  master  with  the  vector  X     consisting  of  plus  ones  corre- 
sponding to  arcs  on  the  cycle  selected  and  zeros  elsewhere.   Note 
that   [b  -  iTa]X  =  1  >  0   so  (6)  is  satisfied. 


which 


The  next  restricted  master  program  is:   Find  A..  ^  0,   x  ^  0 


maximizes  X    , 


subject  to   aX   A,  +  x  =  B. 
J  Is 


The  optimal  basic  feasible  solution  to  this  problem  is  obviously 

x  =0  and 
s 

A,  =     B 


1    I  I  a.. 


where  C   denotes  the  cycle  just  chosen  in  the  subprogram.   The 
associated  value  of   it   is  given  by  (8)  . 


tt  =  — .  (8) 

Ll 
The  objective  of  the  subprogram  is  then  to  maximize 


xpi  "T-r^- 


I  I   a.. 
Ll 
In  other  words,  the  "cost"  for  sending  flow  over  an  arc  in  the  sub- 
program is 

a.  . 
U (10) 

I   I      a.. 

Ll 
for  all  original  arcs  of  the  network  and   -1   for  arc   (P,l). 

The  maximum  value  of  (9)  for  a  flow  of  one  unit  would  be 

obtained  by  selecting  that  cycle  which  had  the  cheapest  "cost"  from 

source  to  sink  and  which  returns  to  the  source  via  arc   (P,l). 

Suppose  we  denote  this  cycle  by  C  .   The  associated  solution  will 

(2) 

be  Xv  '      if  (6)  is  satisfied.   And  (6)  will  be  satisfied  if  (9)  is 

positive.   The  value  of  (9)  for  this  solution  is 

11 


i- 


a .  . 


ll  aij 

ci 


and   therefore    (9)   will  be  positive  only  if 


II      a±i    <      II      air  (ID 

L2  Ll 


Thus  we  introduce  a  new  coefficient  vector  into  the  restricted 
master  only  if  the  route  we  found  on  the  second  visit  to  the  sub- 
program was  shorter  in  the  sense  of  the  a..'s   than  on  the  first 
visit . 

Suppose  we  assume  that  (11)  is  true.   The  new  restricted 
master  then  has  the  form:   Find  A^O,   A^O,   x  k  0  which 

X  £  s 


maximizes   A1  +  A?, 


(1),  s.   „v(2) 

^2  "  ~s 


subject  to  aX^  ;A  +  c 


The  optimal  solution  to  this  master  is   A   =  x  =0  and 


\=^ 


I  I   a., 
because  of  (11)  .   The  associated  value  of  it   is 


1 

IT  = 


I  I  a.. 
L2 
and  the  new  subprogram  objective  function  is 


aX 


1   I  I   ^. 
L2 


The  new  cost  of  sending  a  flow  over  an  arc  is  therefore 


a.  . 

_JJL 


I   I 


(12) 


a.  . 

L2 


for  arcs  of  the  original  network. 

When  we  compare  (12)  with  (10)  we  see  that  only  the  denomina- 
tors differ.   Recalling  that   a.  .  ^  0   for  all  arcs  we  then  realize 

(2) 
that  the  next  solution  to  the  subprogram  will  be  identical  to  X 

because  we  will  get  the  same  cheapest  route  cycle.   The  inequality 

(6)  will  be  violated  and  the  solution  process  will  terminate.   The 

cycle  C_   therefore  consists  of  the  chain  C   defined  in  the 
2  m 

theorem  and  arc   (P,l).   The  value  of   A   is  therefore 


A,  = (13) 

L   c   XJ 

m 
because  ap  =  0. 

(2) 
The  optimal  solution  to  (3a,  b,  c)  is  X*  =  XX     where  A2 

is  given  by  (13) .   Thus  the  arcs  on  the  chain  having  the  shortest 
length  in  the  sense  of   a..'s  between  the  source  and  sink  should 
have  a  flow  of   A   and  their  increased  arc  capacities  should  be  A2 
The  maximal  flow  under  these  conditions  will  be  A    through  the 
network. 

The  following  corollary  is  an  immediate  consequence  of  the 
theorem  if   a..  =  k  for  all  arcs. 


10 


Con.oltaAy:     I  i     a..   =  k     fan.  alt  aA.cn>  o^  the.  n&twon.k  tkzh  the. 
optimal  -solution  U>  to  &pe.nd  alt  o&  the.  budget  on  the.  chain 
having  the.  le.a&t  numbeA  o&  oaca  betwe.e,n  the,  6oun.cn  and  the. 
i>ink.     I  &  thu>  chain  hat     r     uAch  then 

max  Q   =  —r  =  Y . . , 
rk  ij 

wheAe.    Y        li,  the.  capacity  ol  an  an.c  on    C   ,     and  all  otheA 
oaca  have,  zeAo  capacity. 


11 


3.   FINDING  AN  OPTIMAL  SOLUTION  WHEN  M   ^  0 

While  the  decomposition  approach  could  be  used  to  solve  the 
problem  when  M. .  ^  0,   it  would  be  very  inefficient.   Fulkerson's 
modified  primal-dual  algorithm  is  probably  the  most  efficient.   How- 
ever, an  interesting  alternative  scheme  is  suggested  by  the  approaches 
of  McMasters  and  Mustin  (1970)  and  Doulliez  and  Rao  (1971)  for  looking 
at  problems  involving  capacity  reduction  and  expansion.   These 
approaches  require  the  use  of  a  topological  dual  and,  as  a  conse- 
quence, are  not  particularly  efficient.   They  do,  however,  have  a 
conceptual  appeal. 

Both  papers  present  solution  algorithms  which  involve  dual 
shortest  route  problems  for  identifying  the  cut  sets  of  the  primal 
flow  problem.   They  are,  unfortunately,  restricted  to  planar  net- 
works.  This  restriction  has  recently  been  overcome  by  McMasters 
(1971)  who  defines  a  pseudo  topological  dual  associated  with  a  two- 
dimensional  representation  of  the  primal  network.   In  that  paper  the 
special  form  of  the  dual  shortest  route  problem  is  also  stated  and 
an  algorithm  for  solving  the  problem  is  presented.   This  information 
for  both  undirected  and  directed  primal  networks  is  contained  in 
Appendix  A  of  this  paper  for  the  convenience  of  the  reader. 

The  solution  algorithm  presented  below  begins  with  the  con- 
struction of  the  topological  dual  or  psuedo  dual  for  the  primal 
network.   The  length  of  the  shortest  and  second  shortest  routes 
through  the  dual  are  then  determined  for  dual  arc  lengths  equal  to 
the  free  capacity  M. .   of  the  intersected  primal  arcs.   The  length 


12 


of  the  shortest  route  is  then  increased  by  spending  some  of  the 

resource  budget  on  that  arc  of  the  shortest  route.   If  the  entire 

budget  can  be  spent  without  increasing  the  route's  length  to  that 

of  the  second  shortest  route  then  the  procedure  terminates.   If, 

on  the  other  hand,  there  is  still  a  portion  of  the  budget  left  when 

the  shortest  route  reaches  the  length  of  the  second  shortest  route 

then  the  length  of  the  third  shortest  route  is  determined  and  both 

the  minimum  a.,   arcs  of  the  first  and  second  shortest  routes  are 
ij 

increased  until  the  budget  is  used  up  or  the  two  routes  attain  the 
length  of  the  third  shortest  route.  The  process  continues  in  this 
manner  until  the  budget  is  used  up. 


Algorithm: 

1.  Assign  the  M. .   values  as  the  arc  flow  capacities  in  the  flow 
network  (primal  network) .   Construct  its  topological  dual  using 
the  procedures  described  in  Appendix  A.   Find  the  shortest  route 
through  the  dual  and  its  length  L  "  .   Set  n  =  2. 

2.  Find  the  n    shortest  loopless  route  through  the  dual  network 
of  step  1  and  its  length  L    .   Appendix  B  contains  an  n 
shortest  loopless  route  algorithm  due  to  Pollack  (1969)  and 
describes  the  modifications  needed  if  the  primal  network  is 
nonplanar. 

3.  Compute 


B 


n-1 

I 
(n-1)       k=l 


B  -   I      ak[L(n"1>-  L(k)] 


n-1 

k=i  K 


13 


where  a,  =  min  a.,   associated  with  the  arcs  on  the  k 
k        ij 

shortest  route  of  the  dual.   In  the  case  where  the   (k-1)     and 

k    shortest  routes  have  a   "min  a.."   arc  in  common  then  set 

a,  =  0.   If  modifications  were  required  in  Pollack's  algorithm 

because  the  primal  network  is  nonplanar  then  any  shortened  arcs 

appearing  on  the  k    route  should  not  be  included  in  the  a, 

determination  (see  Appendix  C) . 

Increase  the  lengths  of  the  arcs  associated  with  a1,a_,...,a   n 

12      n-1 

by  the  amount   AY     where 

AY(n)  =min{L(n)  -l/1^,  B0*"^}. 

a)  If  AYW  =  B  then  terminate.  The  budget  has  been 
consumed  and  the  optimal  capacity  increase  of  the  primal 
arc  associated  with  a   (r  =  1,2,..., n-1)   is 


(r)     v   AV00 


Y^  =  I      AYW. 


1J    k=r 


For  the  special  case  where  a   was  set  equal  to  zero  in 

(r) 
step  3  do  not  compute  Y..  .   All  other  primal  arcs  will 

have  no  increase  in  arc  capacity.   The  value  of  max  Q   is 

(n-1)    AV(n) 
equal  to  L      +  AY 

b)   If   AY(n)  =  L(n)  -  L(n_1)  <  B(n_1)   then  increase  n  by 

one  and  return  to  step  2. 


14 


4.   AN  EXAMPLE 


Consider  the  flow  network  of  Figure  1  with  directed  arcs  and 
nodes  numbered  from  1   to   5.   The  source  is  node  1   and  the  sink, 
is  node  5.   The  numbers  on  each  arc  represent  M. . ,   a...   The  value 
of   B   is  assumed  to  be  8.   The  preliminary  steps  of  the  dual  con- 
struction are  shown  on  Figure  1  by  the  dashed  lines  and  nodes  with 
letter  labels. 

/  ,  \  \ 


SOURCE 


SINK 


Figure   1. 


The  topological  dual  is  shown  in  Figure  2.   The  numbers  on 
each  arc  represent  the  arc's  length  and  its  associated  a.,   value 
in  that  order.   The  dual  origin  is  node  a  and  the  destination  is 
node  e. 

The  shortest  route  through  the  dual  is  a  -  b  -  e  with  a 
total  length  L    =  3  which  is  the  maximal  feasible  flow  that  the 
primal  network  can  handle  without  paying  for  capacity.   The  second 


15 


shortest  route  without  loops  is   a-d-c-b-e  with  a  length 
(2) 


L 
(a,b) 


=  5.   The  value  of   a   is   1  and  is  associated  with  arc 


0,® 


0,00 


Figure  2 


Note  that   B(1)  =  B/a   =  8.   Because  AY(1)  =  L(2)  -  L(1)  =  2  <  B(1), 

two  units  of  budget  resource  can  be  consumed  before  the  length  of  the 

(2) 
shortest  route  equals  L    . 

The  third  shortest  route  is   a-d-c-e  with  a  length 

(3) 

L    =6.   The  value  of   a_,   associated  with  arc   (d,c),   is   2 

(2) 
and  B    =  2 .   We  lengthen  the  arcs  associated  with  a..   and  a_ 

by  the  amount   AY(2)  =  L(3)  -  L(2)  =  1. 

(4) 
The  fourth  shortest  route  is   a  -  d  -  e  with  L    =  8 .   We 


get   a„  =  an      because  arc   (d.c)   has  the  minimum  a..   value  on  both 
3    2                                     ij 

(3)  (3) 

routes  and   B    =  1.  This  results  in  AY    =  1  and  the  algorithm 


terminates 
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The  lengthened  dual  arcs  are   (a,b)   and   (d,c).   Arc   (a,b) 

has  been  lengthened  by  the  amount   AY^  +  AY^  '  +  AY  ^    =  4.   Arc 

(2)  (3) 

(d,c)   has  been  lengthened  by  the  amount  AYV  '  +   AYV  '    =  2.   The 

primal  arcs  intersected  by   (a,b)   and   (d,c)   are  arcs   (1,3)   and 
(3,4)   respectively.   The  capacities  of  these  arcs  have  therefore 
been  increased  by  4   and   2   respectively.   The  maximal  flow  that 
the  network  can  handle  has  been  increased  from  3   to   7   units. 

The  optimal  flow  through  each  arc  which  would  give  this  maxi- 
mal flow  can  be  easily  obtained  by  setting  the  arc  lengths  of   (a,b) 
and   (d,c)   at  their  final  values  and  determining  the  shortest  dis- 
tances from  the  origin  to  all  nodes  in  the  dual.   It  has  been  shown 
(Sakarovitch  (1970)),  McMasters  (1971))  that  the  optimal  flow  through 
a  primal  arc  in  a  maximal  flow  problem  will  be  equal  to  the  difference 
between  the  shortest  route  distances  to  the  dual  nodes  incident  with 
the  intersecting  dual  arc.   To  illustrate  this  property  we  consider 
Figure  3  where  arcs   (a,b)   and   (d,c)   have  been  increased  in  length 
according  to  the  optimal  solution  above.   The  value  V.   associated 
with  each  node  of  Figure  3  is  its  shortest  route  distance  from  node 
a.   Therefore,  the  optimal  flow  through  primal  arc   (1,3)   is   5 

units  since  V,  -  V  =5.   The  other  optimal  arc  flows  are  shown  in 
b    a 

Figure  4.   The  numbers  on  each  arc  correspond  to  X. . / (M. ,+Y . . ) . 
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Vb-5 


Figure  3, 


2/3 


Figure   4. 
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5.   EXTENSIONS  OF  THE  PROBLEM 

Nonzero  Lower  Bounds  —  Consideration  of  nonzero  lower  bounds 
on  arc  flow  were  not  explicit  in  Fulkerson's  problem  statement. 
Problems  having  negative  lower  bounds  can,  of  course,  be  handled  by 
replacing  the  primal  arc  by  two  oppositely  directed  arcs  having  zero 
lower  bounds  and  positive  upper  bounds. 

The  general  expression  for  a  lower  bound  constraint  for  the 
parametric  budget  problem  could  be  written  as 


L. .  £  X. .  +  W. .  (17a) 

ij     iJ     iJ 

where  W..   represents  the  amount  of  reduction  in  L...   If  each 
iJ  ij 

unit  of  reduction  costs  b..   then  (Id)  would  take  on  the  following 
form: 


V  TA  [a. .Y. .  +  b. .W. .]  £  B.  (17b) 

The  lower  bound  addition  to  the  problem,  regardless  of  the 
sign  of  L..,   is  easily  handled  by  the  algorithm  since  there  is  always 
a  dual  arc  corresponding  to  the  lower  bound  on  flow  (see  Appendix  A) . 
In  the  example  these  arcs  had  zero  length  since  L..  =0   for  all  arcs. 

The  b..   values  are  assigned  to  the  lower  bound  arcs  in  the 
same  way  as  the  a.,   values  are  to  the  upper  bound  arcs  in  the 
Appendix  A  procedure.   The  algorithm  then  considers  the  b..'s  as 
merely  a.,   values  associated  with  certain  dual  arcs. 

To  prevent  an  arc  associated  with  some  L..   or  M. .   from 
being  selected  as  an  a,       arc,  merely  assign  it  a  b..   or  a.. 
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value  very  large.   If  it  is  not  selected  it  will  not  be  changed. 

This  is,  in  fact,  the  reason  for  specifying  infinite  values  of 

a..   for  the  zero  lower  bound  arcs  in  the  procedures  of  Appendix  A. 

Nonlinear  Convex  a(Y..)  —  When  the  cost  to  increase  capacity 
a(Y..)   is  nonlinear  but  convex  and  is  zero  for  Y..  =  0   then  a 
piecewise  linear  fit  to  the  cost  function  for  each  arc  can  be  made 
such  that  the  algorithm  can  be  used  with  minor  modifications.   riu 
(1966),  for  example,  suggests  a  linear  segment  for  each  unit  of 
capacity  change.   Let  a(Y..)   represent  the  general  form  of  the 
cost  function  and  suppose  it  looks  like  Figure  5. 


The  linear  segment  spanning  0  £  Y..  ^  y   would  have  a  slope 


a,,(yJ  = 


a(y]L) 


ij  i    y- 


the  segment  spanning  y.  £  Y .  .  <;  y   would  have  a  slope 
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a(y2)  -  a(y1) 


a±j(y2)  - 


and  so  on . 

The  algorithm  should  begin  by  associating  a..(y1)   values 

with  each  dual  arc.   It  would  proceed  without  change  until  a   "min 

a.."   arc  reaches  its  y1   value.   If  enough  budget  resource  was 

available  to  further  increase  network  capacity  then  the  "min  a.." 

arc  should  have  its  a.,   value  changed  to  a..(y_)   and  a  reappraisal 

ij  °        ij   2 

of  the  a.,   values  for  arcs  of  the  dual  route  currently  under  con- 

sideration  should  be  made  to  see  if  some  other  arc  now  has  a  lower 

a.,   value.   If  so,  the   length  of  the  new  "min  a.."   arc  should 

be  increased  and  the  first  one  ignored.   The  equation  for  B 

in  step  3  of  the  algorithm  should  be  modified  to  incorporate  these 

changes  in  a,   and  an  additional  term  should  be  added  to  the  Y 

equation  in  step  4  to  accommodate  the  break  points   y..  ,   y„,   etc.  , 

in  the  piecewise  linear  fits  to  the  a(Y..)   curves  of  the  dual  arcs 

being  lengthened. 

These  modifications  would  be  directly  applicable  to  problems 

having  linear  a(Y..)   curves  but  upper  bounds  on  Y..   values. 

ij  rr  ij 

An  Interdiction  Problem  —  The  interdiction  problem  studied 
by  McMasters  and  Mustin  (1970)  seeks  to  spend  money  to  reduce  the 
maximum  possible  flow  of  an  enemy's  supply  network.   This  is  done 
by  reducing  the  capacities  of  certain  arcs  of  the  network.   If   Z.. 
is  the  amount  of  capacity  reduction  of  arc   (i,j)   and  a..   is  the 
unit  reduction  cost  then  (Id)  would  have  the  form 
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y  y.  a. .z. .  £  b. 

u   uk     IJ  IJ 
If  M..   is  the  arc  capacity  before  interdiction  and  m..  ^  0   is 

*J  id 

the  least  possible  capacity  after  interdiction  then  (18)  and  (19) 
describe  the  bounds  on  Z..   and  X... 

0  <;  Z.  .  aS  M.  .  -  m.  .  .  (19) 

ij     ij     xj 

0  £  X. .  £  M. .  -  Z. . .  (20) 

ij     ij    ij 

The  algorithm  of  section  3  is  easily  modified  to  solve  this 
problem.   The  a   arc  of  the  dual  shortest  route  would  be  shortened 
in  length  until  it  reached  its  m. .   value  or  the  budget  is  spent. 
If  the  m. .   value  is  reached  first  then  shorten  the  arc  having  the 
next  smallest   a.,   value  until  it  attained  its  m. .   value  or  the 
budget  is  spent.   Repeat  this  process  for  each  successive  arc  of  the 
dual  shortest  route.   The  final  length  of  the  route  should  then  be 
recorded. 

The  dual  second  shortest  route  should  be  analyzed  in  the  same 
fashion  and  its  final  length  compared  with  that  of  the  shortest  route. 
That  route  having  the  shortest  final  length  is  retained  for  further 
comparisons.   This  process  must  be  repeated  for  each  route  through 
the  dual.   The  shortest  final  route  crosses  the  primal  arcs  to  be 
interdicted.   The  amount  of  effort  allocated  to  each  primal  arc  depends 
on  the  length  of  the  intersecting  dual  arc. 
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The  algorithm  presented  in  the  McMasters  and  Mustin  paper  has 
this  same  flavor  but  is  more  efficient  if  m. .  >  0   for  some  arcs. 
Their  procedure  begins  by  finding  the  shortest  route  through  the 
dual  when  all  arcs  of  the  dual  are  set  at  their  m. .   values.   The 
amount  of  money  needed  to  attain  the  shortest  route  length  is  then 
computed.   If  it  exceeds  the  budget  then  some  "unspending"  is  required. 
If  it  does  not  exceed  the  budget  the  problem  is  solved. 

The  "unspending"  looks  for  the  most  expensive  arc  (that  corre- 
sponding to  max  a..)   on  the  dual  shortest  route.   The  length  of 

that  arc  is  then  increased  until  it  reaches  its  M. .   value  or  the 

ij 

budget  constraint  is  satisfied.   If  it  reaches  its  M. .   value  first 
then  the  next  most  expensive  arc  is  also  lengthened.   The  process 
repeats  until  the  budget  constraint  is  satisfied.   The  final  length 
of  the  shortest  route  is  recorded. 

The  second  shortest  dual  route  based  on  m. .   values  is  next 
determined  and  its  length  checked  against  the  final  length  of  the 
shortest  route.   If  it  is  longer  than  that  final  length  the  problem 
is  solved;  otherwise  one  or  more  arcs  of  the  second  shortest  route 
are  lengthened  to  meet  the  budget.   The  final  length  of  the  second 
shortest  route  is  compared  with  that  of  the  shortest  and  the  route 
with  minimum  length  is  retained  for  further  comparisons.   The  process 
continues  until  all  dual  routes  have  been  examined  or  some  dual  route 
having  all  arcs  at  their  m. .   values  exceeds  in  length  the  shortest 
preceding  route  meeting  the  budget  constraint. 
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6.   APPENDIX  A 

Construction  of  the  Topological  Dual  —  The  original  flow  network 
will  be  called  the  primal  network.   A  mesh  of  a  planar  primal  net- 
work is  any  region  surrounded  by  nodes  and  arcs  but  containing 
neither  in  the  plane  on  which  the  network  is  constructed.   The  region 
of  the  plane  completely  surrounding  the  primal  network  will  be  called 
the  external  mesh.   The  construction  of  the  dual  of  a  source-sink 
planar  directed  network  consists  of  the  following  steps  (McMasters 
(1971)). 

1.  Denote  the  original  maximal  flow  network  as  the  primal  network. 
Connect  an  artificial  arc  between  the  sink  and  source  of  the 
primal  and  position  it  below  the  network.   The  resulting  network 
will  be  referred  to  as  the  modified  primal  network. 

2.  Place  a  node  in  each  mesh  of  the  modified  primal  including  the 
external  mesh.   Let  the  origin  of  the  dual  be  the  node  in  the 
mesh  involving  the  artificial  arc  and  the  destination  be  the  node 
in  the  external  mesh. 

3.  For  each  arc  in  the  primal  (except  the  artificial  arc)  construct 
two  oppositely  directed  arcs  that  intersects  it  and  join  with 
nodes  in  the  meshes  adjacent  to  it. 

4.  Assign  the  value  of  the  upper  bound  capacity  of  the  primal  arc 
as  the  length  of  the  intersecting  dual  arc  having  the  same 
direction  that  the  primal  arc  would  have  if  it  were  rotated  90° 
counterclockwise.   Assign  to  the  oppositely  directed  dual  arc  a 
length  equal  to  the  negative  of  the  lower  bound  capacity  of  the 
primal  arc  (these  lengths  will  all  be  zero  for  problem  (1)). 
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If  the  primal  network  is  not  source-sink  planar  then  modify 

step  1  above  to  read: 

1.   Construct  a  two-dimensional  representation  of  the  flow  network 
such  that  all  arcs  are  straight  lines.   Assign  a  psuedo  node  to 
every  intersection  of  arcs  not  at  a  node  in  this  representation. 
Connect  an  artificial  arc  between  the  sink  and  source  of  this 
representation  and  position  it  below  the  network.   The  resulting 
network  will  be  referred  to  as  the  modified  primal  network. 

The  remainder  of  the  steps  for  dual  construction  are  the  same  as 

above. 


Assignment  of   a..   Value  —  Assign  the  a.,   values  of  the  original 
primal  network  to  those  dual  arcs  having  lengths  equal  to  the  M. . 
values.   Assign  a .  .  =  °°   to  all  dual  arcs  corresponding  to  the  lower 


bound  capacity  of  the  primal  arc, 
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7.   APPENDIX  B 

An  n    Shortest  Loopless  Route  Algorithm  —  We  are  interested  in 
loopless  routes  (contain  no  cycles)  through  the  dual  because  we  want 
those  routes  corresponding  to  primal  cut  sets  which  disconnect  the 
primal  into  two  subgraphs,  one  containing  the  source  and  the  other 
the  sink.   We  know  that  any  route  containing  a  cycle  would  not  corre- 
spond to  such  a  cut  set  (Ford  and  Fulkerson  (1956)).   We  are  also 
interested  in  having  an  algorithm  which  allows  us  to  get  the  next 
shortest  route  at  any  time.   Pollack  (1969)  developed  the  following 
algorithm  which  has  both  of  these  features. 

1.  Determine  the  shortest  route  through  the  network  using  an  algo- 
rithm such  as  Dijkstra's  if  all  arc  lengths  are  non-negative  or 

2 
Yen's  if  some  arc  lengths  are  negative  (see  Dreyfus  (1969)). 

2.  To  determine  the  second  shortest  route  remove  the  first  arc  from 
the  shortest  route  and  solve  for  the  shortest  route  through  the 
remaining  network.   This   route  is  a  candidate  for  the  second 
shortest  route.   Record  the  route  and  its  length  and  replace  the 
arc.   Remove  the  second  arc  of  the  shortest  route,  solve  for  the 
shortest  route  through  the  remaining  network,  record  its  length 
and  replace  the  second  arc.   Continue  this  process  until  all  arcs 


A  cut  set  of  a  connected  graph  is  defined  to  be  a  disconnecting  set 
of  arcs  which  contains  no  proper  subset  which  also  disconnects  the 
graph. 

2  Negative  arc  lengths  will  occur  in  the  dual  networks  of  problems 
having  positive  lower  bounds  on  arc  flows.   An  infeasible  flow  is 
detected  by  a  cycle  of  negative  length  in  the  dual  (McMasters  (1971)) 


26 


on  the  shortest  route  have  been  removed  and  replaced.   Examine 
the  list  of  second  shortest  route  candidates.   That  candidate 
having  the  shortest  length  is  the  second  shortest  route.   In  the 
case  of  a  tie  between  two  candidates  arbitrarily  select  one  as 
the  second  shortest  and  specify  the  other  as  the  third  shortest. 

3.  If  there  were  no  ties  for  the  second  shortest  route,  the  third 
shortest  route  candidates  are  determined  by  removing  an  arc  from 
the  shortest  and  an  arc  from  the  second  shortest  routes  and  solving 
for  the  shortest  route  through  the  remaining  network.   This  must 

be  done  for  all  combinations  of  two  arcs  from  the  shortest  and 
second  shortest  routes.   The  list  of  candidates  is  then  examined 
and  the  third  shortest  route  is  that  candidate  having  the  shortest 
length. 

4.  The  n    shortest  route  is  obtained  by  first  finding  the  shortest 
route  through  the  remaining  network  after  each  combination  of 
arcs,  one  from  each  of  the  preceding  n-1   shortest  routes,  has 
been  removed.   That  candidate  having  the  shortest  length  is  the 

n    shortest  route. 

Modifications  for  a  Nonplanar  Primal  —  If  the  primal  network  is  not 
source-sink  planar  then  loopless  routes  through  the  dual  may  not 
correspond  to  cut  sets  of  the  original  primal.   Modifications  to 
Pollack's  algorithm  may  therefore  be  required  to  insure  selection 
of  the  correct  dual  routes. 
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Let  the  dual  nodes  be  numbered   1,2,...,N  where   1 
corresponds  to  the  dual  origin  and  N  corresponds  to  the  dual 
destination  or  terminal  node.   Let  the  group  of  four  dual  nodes 
surrounding  a  primal  pseudo  node  (J>  be  represented  by   (i,j,k,m)  . 
Let   $  be  the  set  of  all  such  groups  in  a  dual  network.   Let  V. 
represent  the  permanent  label  on  dual  node   i  after  the  shortest 
route  from  the  dual  origin   (V  =  0)   to  every  dual  node  has  been 
determined.   Let  I.,      be  the  length  of  the  dual  arc   (i,j).   If, 
during  each  step  of  Pollack's  algorithm, 

V.  -  V.  =  V  -  V,  (18) 

j     l    m    k 

for  all  node  sets  of   $   then  no  modifications  are  necessary.   If 
(18)  is  not  satisfied  for  some  set  then  use  the  following  subroutine 
to  change  the  V.   values.   McMasters  (1971)  explains  the  reasoning 
behind  condition  (18)  and  proves  that  this  subroutine  does  accomplish 
the  desired  result. 


Adjustment  Subroutine: 

1.   Compute  a  set  of  numbers  Y.   (i  =  1 ,2 , . . . ,N) ,  where  Y^  =   V^ 
and 

Y.  =  max(Y.-£.  .) 
k        l   lj 
J 

for   i  =  1,2,.. .,N-1. 
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2.   For  each  set   (i,j,k,m)    for  which  (18)  is  not  satisfied  compute 
the  following  numbers : 


*!<♦>  =  minUirvrYi' vv 


ft  _(<)>)  =  min{-£..,Y.-V.,Y  -V.  } 
2  ji  j   i  m  k 


If  I    (((>)  <  £_(<{>)   for  one  or  more  sets  then  go  to  step  3; 
otherwise,  go  to  step  4. 
3.   Determine  that  set   (i,j,k,m)*'   corresponding  to 

fc2((f))  -  Z±(0    =   max{£2(<}.)  -  l^)     \    J^U)  <    l^)} 


and  change  I...      I...      I,     ,   and  I  .       of  the  arcs  associated 
l  j     j  l    km         mk 

with  that  set  to 


ij     km    1  T 

a! .  =  «,*  =  -i.  (<j>) . 

31    mk     1 

Go  to  step  5. 

4.   Select  any  set   <i,J,k,.)+  for  which  (18)  is  not  satisfied  and 

change  the  values  of  I . . ,      I . . ,  I,     ,   and  I  .       on  the  arcs 

ij     ji    km         mk 

associated  with  that  set  to 


l\.   -  If     =  JL(<|>), 
ij     km    1 


j  1    mk     rT' 
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5.   Recompute  the  shortest  routes  from  the  dual  origin  to  each  node. 

(a)  If  (18)  is  not  satisfied,  return  to  step  1  of  this  subroutine. 

(b)  If  (18)  is  satisfied,  record  the  shortest  route  through  the 
dual  and  its  length.   Identify  any  shortened  arcs  on  this 
route.   If  this  route  is  later  found  to  be  the  k    shortest 
route  then  these  arcs  should  not  be  "removed"  on  subsequent 
iterations  of  Pollack's  alforithm.   Return  all  shortened 
arcs  to  their  original  lengths  and  continue  with  Pollack's 
algorithm. 

The  adjustment  subroutine  artificially  reduces  the  lengths 
of  certain  arcs  of  the  dual.   At  the  end  of  the  subroutine  one  or 
more  of  these  arcs  may  appear  on  the  shortest  route.   In  searching 
for  the  next  shortest  route  using  Pollack's  algorithm,  these 
shortened  arcs  should  not  be  removed  since  "removal"  is  normally 
accomplished  in  shortest  route  algorithms  by  assigning  an  infinite 
length  to  the  arc.   Increasing  the  original  length  of  a  shortened 
arc  would  result  in  the  route  just  determined  by  the  adjustment  sub- 
routine being  also  determined  as  a  candidate  for  the  next  shortest 
route. 
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8.   APPENDIX  C 


Selection  of  a.   Arcs  for  a  Nonplanar  Primal  —  The  adjustment 
subroutine  of  Appendix  B  may  cause  arcs  on  a  dual  k    shortest 
route  to  be  shortened.   Because  increasing  the  original  length  of 
a  shortened  arc  would  not  increase  the  length  of  the  k    shortest 
route  we  would  gain  no  increased  primal  flow  capacity.   Therefore, 
we  should  select  that  arc  corresponding  to   "min  a.."   from  only 
those  arcs  on  the  route  which  were  not  shortened  by  the  subroutine. 
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